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(57) Abstract 

The present invention is a portable client PDA with a touch screen or other equivalent user interface and having a microphone and 
local central processing unit (CPU) for processing voice commands and for processing biometric data to provide user verification. The PDA 
also includes a memory for storing financial and personal information of the user and I/O capability for reading and writing information to 
various cards such as smartcards, magnetic cards, optical cards or EAROM cards. The PDA includes a Universal Card, which is common 
generic smartcard with a unique imprint provided by a service provider, on which selected financial or personal information stored in the 
PDA can be downloaded to perform certain consumer transactions. The PDA includes a modem, a serial port and/or a parallel port so 
as to provide direct communication capability with peripheral devices (such as POS and ATM terminals) and is capable of transmitting 
or receiving information through wireless communications such as radio frequency (RF) and infrared (IR) communication. The present 
invention is preferably operated in two modes, i.e., a client/server mode and a local mode. 
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A PORTABLE INFORMATION AND TRANSACTION PROCESSING 
SYSTEM AND METHOD UTILIZING BIOMETRIC AUTHORIZATION 
AND DIGITAL CERTIFICATE SECURITY 

5 Field of the Invention 

The present invention relates to a portable information and 
transaction processing system and method and, more particularly, to a 
portable information and transaction processing system and method which 
10 utilizes digital certificate security and biometric authorization to 

provide personal verification prior to processing user requested financial 
transactions and providing personal information. 

Background of the Invention 

15 

It is now widely accepted in the domestic consumer market that 
purchasing or selling goods or services with credit cards at point of sale 
(POS) terminals, as well as performing electronic transfer of funds at 
automated teller machine (ATM) terminals using ATM cards, is more 

20 efficient than using cash to pay for goods or services or paying debts. 

Utilizing cash as a meajis for purchasing goods or paying debts is 
generally viewed as burdensome for several reasons. First, in terms of 
accounting, the consumer must manually generate records and reconcile his 
or her accounts to keep track of such cash transactions. By utilizing a 

25 credit card issued by a financial institution, however, consuaner 

transactions are recorded by such f ineoicial institution and accoxintings 
are provided to the consiamer on a monthly basis, which provides improved 
accounting and reconciliation. 

3 0 In addition, using cash is a financially insecure method for 

protecting consumers against fraud and theft. For example, if a consumer 
believes that he or she has been sold an inferior or over-priced product, 
which frequently occurs during cjuick confiumer transactions where the 
consumer may not have adequate time to reflect on the purchase until some 

35 time after such purchase, it is much easier for the consigner to contact 

the financial institution to stop payment on goods purchased using a 
credit card than it is for the user to recover cash from the merchant from 
whom such goods were bought. Moreover, it is virtually impossible for a 
consumer to recover cash that has been stolen or lost. On the other hand, 

40 if the consumer's credit cards are stolen or lost, the consumer can 

contact the corresponding financial institution to cancel such cards and 
obtain new credit card accounts. 



Accordingly, there is a strong trend today in moving towards a 
45 "cashless society," which has caused a substantial increase in the use of 
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credit cards, ATM cards and direct debit cards (collectively, "financial 
cards") for performing consumer transactions. Notwithstanding the 
perceived benefits of using financial cards rather than cash, there exists 
several disadvantages in using these cards. For example, if the consumer 
5 frequently uses a significant nxamber of financial cards, the consumer must 

physically possess all such cards in order to access a desired account. 
Having to carry such a large niimber of financial cards can be extremely 
burdensome to the consximer since a substantial amount of space is occupied 
by these cards in the consiimer's wallet or purse. Moreover, if the wallet 
10 or purse is lost or stolen, the consumer must contact the financial 

institution for each financial card to cancel the account so as to prevent 
an unauthorized user from transacting business with such cards, which is 
also a burdensome task. 

15 Another disadvantage in using financial cards is that consumers are 

not fully protected from the unauthorized use of lost or stolen cards. 
For example, a merchant can confirm the ownership of a credit card during 
a consumer transaction by comparing the authorized signature that is {or 
should be) written on the back of the credit card with the signature of 

20 the person signing the credit card receipt. Realistically, merchants 

generally do not compare these signatures during such a transaction, and 
even if they do, they may not compare such signatures with the level of 
scrutiny or skill needed to distinguish minor differences between the 
consumer's signature and the xinauthorized user's forged signature. 

25 Therefore, during the period of time between the time the consumer's 

credit card is lost or stolen and the time the consumer realizes such loss 
or theft and cancels the account, an unauthorized user who has found or 
stolen the card may charge a substemtial amount of money to the consumer's 
card, leaving the consumer with the burden of having to dispute such 

30 unauthorized charges with the financial institution. 

Disclosure of tlie invention 

It IS therefore an object of the present invention to provide a 
35 portable information smd transaction processing device ("personal digital 

assistant" or "PDA") in which a user can store his or her credit card, ATM 
card and/or debit card (i.e., financial) information, as well as personal 
information, and then access and write selected information to a smartcard 
("Universal Card"), which is then used to initiate a POS, ATM, or consumer 
40 transaction. 

It is another object of the present invention to provide a PDA 
device which utilizes biometric security to provide user verification 
prior to accessing and writing the selected financial and personal 
45 information to the Universal Card. 
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It is yet another object of the present invention to provide a PDA 
device with digital certificate security, whereby the user is required to 
periodically download a temporary digital certificate from a central 
server of the service provider of such Universal Card into the PDA device 
5 prior to accessing and writing the selected financial and personal 

information to the Universal Card, 

It is still another object of the present invention to provide a PDA 
device with digital certificate security which is compatible with the 
10 current infrastructure (i.e., immediately employed without having to 

change the existing infrastructure) and which brings biometric security to 
electronic data transfer systems that are currently unable to perform 
biometric verification. 

15 It is yet another object of the present invention to provide a PDA 

device with digital certificate security which can be extended to all 
applications or systems wherein magnetic and/or smartcards are used such 
as access control cards for accessing a device service or building, cash 
cards for performing ATM trems act ions , calling cards or cellular cards 

20 (for e.g., GSM (Group Special Mobile) digital cellular mobile radio 

system) for making telephone calls and employee cards for accessing 
confidential information. 

In one aspect of the present invention, a portable information and 

25 transaction processing device, comprises: central processing unit for 

controlling the functioning and for processing a plurality of operations 
of the device; memory means, operatively coupled to the central processing 
unit, for storing financial and personal information and for storing a 
temporary digital certificate; communication means, operatively coupled to 

30 the central processing unit, for establishing a communication link with a 

central server at a remote location to obtain the temporary digical 
certificate; user interface meems, operatively coupled to the central 
processing meems, for initiating at least one of the plurality of 
operations of the device and selecting a portion of one of the financial 

35 emd personal information from the memory means; a universal card, 

detachably coupled to the central processing unit, for receiving the 
selected portion of one of the financial and personal information; emd 
programming meems, operatively coupled to the central processing unit and 
responsive to the temporary digital certificate, for writing the selected 

4 0 portion of one of the stored financial and personal information to the 

universal storage card, whereby the programming means is prevented from 
writing the selected portion of one of the financial and personal 
information to the universal card when the temporary digital certificate 
is invalid. 



45 
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The present embodiment is a portable client PDA with, a touch screen 
or other equivalent user interface, which includes a microphone and a 
local central processing unit (CPU) for processing voice activated 
commands and for processing biometric data to provide biometric 
5 verification of a user. The present invention includes a memory for 

storing financial and personal information of the user and I/O capability 
for writing and reading information to and from various cards such as 
smartcards, magnetic cards, optical cards or EAROM (electrically alterable 
read-only memory) cards. The present invention includes a Universal Card, 

10 which is a common generic smartcard with a unique imprint (i.e., an 

account number) provided by a service provider, on which selected 
financial or personal information stored in the PDA can be downloaded to 
perform various transactions. The PDA preferably includes a modem and a 
serial port and/or a parallel port so as to provide direct communication 

15 capability with peripheral devices. The PDA is also capable of 

transmitting or receiving information through wireless communications such 
as radio frequency (RF) and infrared (IR) communication. 

The present invention is preferably operated in two modes, i.e., a 
20 client/server mode and a local mode. The client/server mode is 

periodically performed to download a temporary digital certificate from a 
central server of the service provider of the PDA and Universal Card. The 
client/server mode is performed by establishing communication between the 
PDA and a central server of the service provider via modem or wireless 
25 communication. Once communication is established, the central server 

verifies the user either biometrically or through PIN or password or a 
combination thereof, and then generates a temporary digital certificate 
which is downloaded into the PDA. A temporary, unexpired digital 
certificate is necessary to access selected information stored in the PDA 
30 and write such information to the Universal Card. 

Next, the local mode of operation of the PDA is performed to 
initiate a consumer transaction. Preferably, in the local mode, rhe user 
selects one of the pre -enrolled credit cards that are stored on the PDA by 

35 stating a verbal command into the microphone of the PDA, whereby the CPU 

processes the verbal command and performs user verification. 
Alternatively, user verification (i.e, local verification) may be 
performed by using either biometric data, PIN or password, or a 
combination thereof. Upon local verification, the selected information is 

40 retrieved from memory and written to the Universal Card which is then 

available to commence a transaction. In the absence of an unexpired 
digital certificate, however, the selected information will not be written 
to the Universal Card notwithstanding that the user may have passed local 
verification. 



45 
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The present invention advantageously eliminates the burden of having 
to carry a multitude of financial cards and/or credit cards that a user 
may frequently utilize. The financial information for each card may be 
stored in the PDA and written to the Universal Card when needed. If the 
Universal Card is lost or stolen, the user will only have to contact the 
service provider to cancel and reissue a new account. In addition, due to 
the biometric and digital certificate security which protects against the 
unauthorized access to the user's financial and personal information, a 
lost or stolen universal Card is useless to an unauthorized user. 



Further, the present invention may be immediately employed without 
the need for changes in the existing infrastructure since the PDA and 
Universal Card may be utilized with any system which utilizes magnetic 
cards or smartcards for electronic data transfer such as point of sale 
15 {POS) terminals or automated teller machines (ATM) which provide direct 

debit capability. 



Brief Description of the Drawings 

20 

Fig. 1 is a block diagram illustrating elements of a portable 
information cind transaction processing device according to an embodiment 
of the present invention; 

25 Figs, 2a and 2b are diagrcuns of the Universal Card according to an 

embodiment of the present invention; ^ 

Fig. 3 is a block diagram showing the interaction of the portable 
information and transaction processing device in connection with 
3 0 processing a transaction according to the present invention; 

Fig. 4 is a flow diagram illustrating the client/server mode of 
operation ir, accordance with the present invention; 

35 Fig. 5 is a flow diagram illustrating the local mode of operation in 

accordance with the present invention; and 

Fig. 6 is a flow diagram illustrating another local mode of 
operation in accordance with the present invention. 



Detailed Description of Preferred Embodiments 



It is to be understood that seune or similar components illustrated 
throughout the figures are designated with the same reference numeral. It 
45 is to be further understood that the elements or functional modules 
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described herein in accordance with the present invention may be 
implemented in various forms of hardware, software, or a combination 
thereof. Preferably, the main biometric verification elements and speech 
recognition elements are implemented in software and may include any 
5 suitable and preferred processor architecture for practicing the invention 

by programming one or more general purpose processors. It is to be 
further understood that, because some of the components of the invention 
described herein are preferably implemented as software modules, the 
actual connections shown in the figures may differ depending upon the 
10 manner in which the invention is programmed. Of course, special purpose 

processors may be employed to implement the invention. 

Referring initially to Fig. 1, a block diagram illustrating elements 
of the portable information and transaction processing (PDA) device 10 
according to an embodiment of the present invention is shown. The heart 
of the device is a central processing unit (CPU) 12, which controls the 
operations of the PDA device 10 via programs stored in a memory 14 and 
executed by the CPU 12. Specifically, the CPU 12 includes an acoustic 
processor module 16 for processing voice commands inputted into the PDA 
device 10 through a microphone 18. The acoustic processor module 16 is 
also used for performing local speaker verification. The CPU 12 also 
includes a digital certificate processor module 20, for processing a 
digital certificate obtained in the client/server mode of operation (to be 
discussed in detail below) , and a biometric processor module 22, for 
processing biometric data in addition to, or alternative to voice data, to 
provide user verification. The CPU 12 further includes an 
encrypter/decrypter module 24 for encrypting the personal and financial 
information before being stored in memory 14 and for decrypting such 
information when accessed by the user. Although the illustrative 
embodiment herein shows the CPU 12 comprising the digital certificate 
module 20, the encrypter/decrypter module 24, the acoustic processor 
module 16 and the biometric processor module 22, it is to be understood 
that such modules may also be implemented as special purpose modules each 
having a processor, associated memory and stored programs for performing 
such fiinctions. 

The PDA device 10 includes a smartcard reader /writer 26 (as is known 
in the art) for reading and writing information to and from various cards, 
e.g., magnetic cards, IC cards and/or EAROM cards (using known standards 
40 and techniques). During the local mode of operation of the PDA device 10, 

a Universal Card 26 of the present invention is inserted into the 
smartcard reader/writer 3 0 and, upon user verification, selected financial 
or personal information is written to the Universal Card 26. when not in 
use, the Universal Card 26 may be stored in a smartcard storage 
45 compartment 32 of the PDA device 10. 



20 



25 



30 
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The PDA device 10 includes a user interface/display 34, which is 
preferably a liquid crystal display (LCD) touch screen display (or 
equivalent user interface) , for displaying and/or inputting data 
associated with the operations or functions of the PDA device 10. 
5 Alternatively/ the interface/display 24 may be comprised of a keyboard and 

a conventional LCD display. Additionally, the PDA device 10 may audibly 
communicate with or request information from the user through a speaker 26 
which is operatively connected to the CPU 12 via a text- to -speech 
converter 38. The text -to- speech converter 3 8 converts signals from the 

10 CPU 12 into synthesized speech which is then heard through the speaker 36. 

The PDA device 10 may be configured to simultaneously display such 
information along with generating the synthesized speech. Furthermore, 
the PDA device 10 may operate without a display (or a limited display) and 
rely on the text- to- speech functions to communicate information to the 

15 user of such device. 

A biometric sensor 40 of any conventional type may also be provided 
for collecting biometric data (other than voice data which is received by 
the microphone 18) such as a finger, thumb or palm print, a hcindwriting 

20 sample, a retinal vascular pattern, or a combination thereof, to provide 

biometric verification as an alternative to, or in addition to, voice 
biometric verification. This data is theii processed by the biometric 
processor module 22 to provide user verification (i.e., biometric 
security) prior to accessing the financial ajnd personal information stored 

25 in memory 14. It is to be appreciated by one of ordinary skill in the art 

that the biometric verification features of the PDA device may be replaced 
or supplemented with a PIN (personal identification number) or password to 
provide user verification. 

30 The PDA device 10 may preferably be equipped with various 

communication ports such as a serial port 42 and a parallel port 44 
(utilizing known computer interface standards) , operatively coupled to the 
CPU 12, as well as a telephone line interface 46 (using a known interface 
connections) , to provide means for establishing a communication link 

35 between the PDA device 10 and other peripheral devices such as computers, 

modems and printers. For establishing wireless communication, the device 
may preferably be equipped with an RF processor module 48, operatively 
connected between the CPU 12 and an RF port 50, for processing incoming RF 
information received by the RF port 50, and for generating transmission 

4 0 signals which are outputted from the RF port 5 0 using conventional 

constructions and techniques. The device may also be equipped with an IR 
processor module 52, operatively connected between the CPU 12 and an IR 
port 54, for processing incoming optical information and for generating 
output optical signals using conventional constructions and known 

45 techniques. Preferably, the PDA device 10 includes a DTMF (dual tone 
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multi - frequency) processor module 56 and a modem 58, operative ly coupled 
between the CPU 12 and the telephone line interface 46. Communication of 
financial information may be accomplished via modem coimnunication and/or 
DTMF tone communication on a telephone line, using known methods. DTMF 
5 communication may be used for processing PINs for user verification and 

authorization . 

Referring now to Figs. 2a and 2b, diagrams of the Universal Card 2 6 
according to an embodiment of the present invention are shown. The 
Universal Card 26 is essentially a generic smartcard which includes either 
a magnetic band 28 (Fig. 2a) or integrated chip (IC) 29 (Fig. 2b), or 
both, for storing the selected information which is retrieved from the 
memory 14 and written to the Universal Card 26 through the smartcard 
reader/writer 30 during the local mode of operation of the PDA device 10. 
The Universal Card 26 (issued by a service provider) contains a unique 
Universal Card nximber 27 imprinted thereon, which corresponds to the 
designated user account number provided by the service provider (which is 
analogous to the account number provided on a credit card or ATM card) . 

As more fully discussed below, the Universal Card number 27 may be 
utilized to provide user verification in consumer POS transactions 
utilizing a traditional mechanical sweeper instead of a magnetic sweeper 
which is capable of magnetically reading the magnetic band 28 of the 
Universal Card 26. The unique Universal Card number 27 may also be used 
for to provide user verification in instances where consumer treinsactions 
are performed remotely over a telephone. In such instcince, as explained 
below, an authorization number, which is unique to the current digital 
certificate, will be displayed on the PDA device 10 upon user 
verification. The authorization number, together with the unique 
Universal Card number 27, may be used to verify the user. 

Referring to Fig. 3, a blocic diagram illustrating the interaction of 
the PDA device 10 in connection with processing a transaction according to 
the present invention is shown. The user of the PDA device 10 and 
35 Universal Card 26 (Figs. 1 and 2) must first perform an enrolment 

procedure with a service provider. Enrolment involves obtaining a 
universal Card 26 with a designated account number (i.e., the unique 
imprint 27 on the Universal Card 26) and providing the service provider 
with the user's credit card or ATM card information so that such 
40 information can be verified with the financial institutions 70 that issued 

such cards. This information is then stored on a central server 60 of the 
service provider. The user may then subsequently download such 
information into the PDA device 10 by establishing a communication link 
(lil) with the central server 60. Alternatively, the credit cards or ATM 
45 cards may be loaded into the PDA device 10 by directly reading information 



10 



15 



25 
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contained on such cards through the smartcard reader/writer 3 0 of the PDA 
device 10. In such a situation, the PDA device 10 will compare the user 
ID of the credit cards with the user ID of the PDA device to verify the 
user so as to prevent a user from downloading the information from cards 
5 owned by another person into the user's PDA device 10. In the event that 

the PDA device is unable to verify the owner of a card which is being 
directly downloaded via the smartcard reader /writer 3 0 (i.e., the card 
does not contain the name of its owner) , the user will be required to 
enrol the card by providing the service provider with the card information 
10 (to obtain verification from the appropriate financial institution) and 

then connect to the central server 60 to download the card information. 

Enrolment also involves providing the service provider with personal 
information such as the user's social security number, address, maiden 

15 name and date of birth, which is stored on the central server 60. Such 

information is then used to verify the user during the client/server mode 
prior to the issuance of a digital certificate. A personal identification 
number PIN and the Universal Card 26 with a unique account number 27 is 
provided by the service provider. This information, as well as biometric 

20 data such as voice prints (models) of the user, are also stored in central 

server 60 of the service provider for user verification during the 
client/server mode to obtain a digital certificate (to be discussed in 
detail below) , The central server 60 is a computer which is programmed to 
perform the functions described herein such as biometric verification, 

25 speech recognition and generating and downloading a temporary digital 

certificate. ^ 

Referring to Figs. 1, 3 and 4, the client /server operating mode of 
the present invention is now described. As indicated above, the user must 

30 periodically connect the PDA device 10 with the central server 60 of the 

service provider (Link Ll, Fig. 3) in order to obtain a valid digital 
certificate from the central server 60 prior to initiating a consumer 
transaction. Specifically, the digital certificate is binary encrypted 
file that must be downloaded into the PDA device 10 before personal or 

35 financial information of the user can be written to the Universal Card 26. 

The digital certificate contains information relating to (but not limited 
to) the account number of the PDA device 10, the date on which the digital 
certificate was authenticated and its expiration date, as well as ajiy 
constraints which exist for each enrolled card. The digital certificate 

40 is stored in the memory 14 of the PDA device 10. Prior to the execution 

of a transaction (i.e., downloading selected card information from the 
memory 14 to the universal Card 26), the digital certificate is decrypted 
by the encrypter/decrypter module 24 and loaded into the digital 
certificate processor module 2 0 wherein it is processed to determine if it 

45 is valid. 
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In order to obtain the digital certificate, the user must establish 
a communication link (Link Ll, Fig. 3) with the central server 6 0 of the 
service provider (step 100, Fig. 4) . Communication may be established by 
dialling into the central server 60 through a telephone line via the modem 
5 58 and telephone line interface 46. It is also contemplated by the 

present invention that communication may be established with the central 
server 60 through a digital communication channel such as internet, 
intranet or local area network. Alternatively, communication between the 
PDA device 10 and the central server 6 0 may be established through 

10 wireless communications, e.g., via the RF port 50 and the RF processor 

module 48, Further, the PDA device 10 may be connected to the central 
server via a special ATM (or other such kiosks) which uses intranet and 
TCP/IP to connect to the central server 60. it is to be understood that 
the PDA device 10 may be operatively linked to the kiosk either directly 

15 (e.g., via serial or parallel ports 42 and 44) or through wireless 

commiinication via the RF port 50 or the IR port 53. As demonstrated 
above, it is to be appreciated by one of ordinary skill in the art that 
the central server 60 of the present invention is accessible through any 
conventional communication channel. 

20 

Once communication has been established, the user is prompted 
(either by text on the user interface/display 34 or verbally through the 
text- to -speech converter 38 and speaker 3 6) to enter certain verification 
data (step 102) . Such data is then transmitted to the central server 60 

25 via the communication link L.1 . Specifically, the central server 60 may 

ask the user a series of questions (which are randomly chosen from the 
totality of questions asked and answered during the enrolment process) . 
Such questions are received by the CPU 12 of the PDA device 10 and either 
displayed on the user interface display 34 or sent to the text - to - speech 

30 converter 38, where they are converted to synthesized speech and audibly 

transmitted to the user through the speaker 36. The central server 6 0 may 
also prompt the user to enter the PIN that was issued to the user during 
the enrolment process. 

35 If such requested verification data is not provided within a pre- 

determined time (step 104) , the central server 60 will automatically 
disconnect the communication link LI, and a digital certificate will not 
be downloaded (step 106) . On the other hcind, if the user enters the 
requested verification data in timely manner (step 104) , the central 

40 server 60 will process such data (step 108) . The user may provide the 

requested verification data by providing answers to the questions by 
speaking into the microphone 18. The audio signals are then received by 
the CPU 12 and then directed to the acoustic processor module 16, wherein 
the user's answers are processed and transmitted to the central server 6 0 

45 via the coiranunication link LI. In addition, the user may enter his or her 
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assigned PIN through the user interface/display 34. This PIN is then 
processed by the DTMF processor module 56 to generate corresponding tone 
signals which are received and processed by the central server 60. 
Preferably, the PIN can be provided by stating, e.g., "My pin number is 
5 3456" into the microphone 18, wherein the audio signals are processed by 

the acoustic processing module 16, and then transmitted to the central 
server 60 via the established communication link Ll . 

While the user is entering the requested verification data, the 
10 central server 60 begins processing the verification data (step 108) . 

Specifically, the central server 60 will perform speaker verification to 
compare the user voice models that were processed and compiled by the CPU 
12 of the PDA device 10 with the user's voice prints that were stored in 
the central server 60 during the enrolment process. Further, the central 
15 server 6 0 compares the answers given by the user with the answers provided 

during the enrolment process to determine if they match. The central 
server 60 may also verify whether the PIN entered by the user corresponds 
to the PIN that was issued during the enrolment process. If, after 
processing the verification data, the central server 60 determines that 
20 the user is not an authorized user (step 110) , the communication link Ll 

will be disconnected and no digital certificate will be downloaded (step 
106) . 

It is to be appreciated that any conventional speech/ speaker 

25 recognition system may be employed by the present invention. The present 
invention is not, in any way, limited to use with or dependent on any 
details or methodologies of any particular speech/speaker recognition 
system which may be employed. Preferably, the speaker recognition system 
utilized by the central server 60 and the PDA device 10 in accordance with 

30 the present invention is a system which performs text - independent speaker 

verification and asks random questions, i.e., a combination of speech 
recognition, text independent speaker recognition and natural language 
understanding using acoustic and non- acoustic models to provide security 
from unauthorized access to a service/ f acility (i.e., the central server 

35 60) such as disclosed in U.S. Serial No. 08/871,784, filed on Jxine 11, 

1997, and entitled: "Apparatus And Methods For Speaker Verification / 
Identification / Classification Employing Non-Acoustic And/Or Acoustic 
Models and Databases," which is commonly assigned to the assignee of the 
present invention. More particularly, the text - independent speaker 

40 verification system is preferably based on a frame-by frame feature 

classification as disclosed in detail in U.S. Serial No. 08/788,471 filed 
on January 28, 1997 and entitled: "Text independent Speaker Recognition 
for Transparent command Ambiguity Resolution And Continuous Access 
Control," which is commonly assigned to the present assignee. 

45 



wo 99/08238 



PCT/GB98/02283 



12 



AS explained in the above reference U.S* Serial No. 08/871,784, 
text - independent speaker recognition is preferred over text - dependant or 
text -prompted speaker recognition because text independence allows the 
speaker recognition function to be carried out in parallel with other 
5 speech recognition-based functions in a manner transparent to the caller. 

It is to be understood, however, the present invention can employ text- 
dependant or text - prompted speaker verification. 

It is to be further appreciated that a automatic speech/speaker 
10 recognition system disclosed in U.S. Serial No. 08/873,079, filed on June, 

11, 1997, entitled "Portable Acoustic Interface For Remote Access to 
Automatic Speech/Speaker Recognition Server, " which is commonly assigned 
to the present assignee, may preferably be employed in the present 
invention to provide for accurate speech recognition communication in 
15 remote transactions between the PDA device 10 and the central server 60. 

Particularly, as explained in above U.S. Serial No. 08/873,079, 
there are certain problems associated with remote communications between a 
server/client systems utilizing automatic speech/speaker recognition. 

20 Such problems include the loss of accuracy of data due to degradation of 

voice data which is tremsmitted over a communication channel and the 
varied background noises at the user end which reduces the accuracy in 
speech recognition. Such problems are remedied by pre-processing the 
speech signals that are transmitted over the communication channel to the 

25 server. Such pre-processing includes characterizing the acoustic features 

of the transmitting device, the environment, the speaker and the 
communication channel, whereby such information is then processed by the 
central server to set references, select appropriate decode models and 
algorithms to recognize the speaker or decode the speech by modelling the 

30 channel transfer function and the background noise to reduce the word 

error rate of the speech or to accurately perform speaker recognition. 

Referring back to Fig. 4, if, on the other hand, the user is 
verified (step 110) , the central server 60 will then prompt the user to 

35 provide certain transaction limitations such as the specific financial 

card information to be used, the limit on the amount of allowed spending 
allowed over the lifetime of the temporary digital certificate and/or the 
period of time in which the temporary digital certificate will remain 
valid (step 112) . This information is received cuid processed by the 

40 central server 60 and a digital certificate is then created and encoded 

with the user requested limitations (step 114) , This digital certificate 
is then encrypted by the central server 60 and downloaded into the digital 
certificate processing module 20 of the CPU 12 via the established 
communication link Ll (step 116) . It is to be understood that the present 

45 invention may employ any known encryption technique or algorithm for the 
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encrypt ion/decrypt ion process, such as those disclosed in "Applied 
Cryptography," by Bruce Schenier, second edition, Wiley, 1996. The 
digital certificate is then stored in the memory 14 of the PDA device 10. 
With a valid digital certificate, the user can then perform the local 
5 operating mode of the PDA device 10. 

It is to be appreciated that, as demonstrated above, the present 
invention may utilize PIN or password protection in addition to, or in 
lieu of, biometric verification to obtain the necessary digital 

10 certificate from central server 60. Moreover, the methods disclosed in 

the above -referenced U.S. Serial No. 08/873,079 may be utilized in the 
present invention to remotely authenticate, reset or revoke the user's 
password, logons, PIN and/or encryption/decryption keys, whereby the user 
may establish communication with the central server 6 0 (via the PDA device 

15 10) to request, e.g., a PIN change. 

Referring now to Figs. 1, 3 and 5, the local operating mode of the 
present invention is now described. The local mode of operation is 
commenced by the user selecting a pre -enrolled credit card that is stored 

20 in memory 14 (step 200) . The selection process is preferably performed by 

voice activated commands (e.g., by stating into the microphone 18 "I want 
to use my American Express Card") . Such voice commands are then received 
by the CPU 12 and processed in the acoustic processor module 16. It is to 
be appreciated that any known command and control engine for speech 

25 recognition may be employed in the present invention such as the 

commercially available large vocabulary IBM VIAVOICE GOLD system to 
perform the speech recognition functions in accordance with the present 
invention. 

30 Alternatively, the desired card may be selected through the user 

interface/display 34. The CPU 12 then searches the memory 14 for the 
desired information (step 202) . If the card was not previously stored in 
the PDA device 10 during the enrolment process, the user will be prompted 
to select another card (step 204) . 

35 

If the requested card information is found in memory, biometric 
verification must be performed before the card information can be written 
to the Universal Card 26. Alternatively, as stated above, PIN or password 
verification by be perfonned in lieu of, or in addition to, biometric 

4 0 verification. in the preferred embodiment of the present invention using 

voice activated commands to select the desired card, the microphone 18 
functions as a biometric sensor for receiving biometric voice data. This 
biometric voice data is then sent to the acoustic processor module 16 
wherein such data is processed (step 206) by comparing the current 

45 biometric voice data with the user's voice models stored in memory 14. 
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Although such verification may be performed by any conventional method, 
the speaker verification methods disclosed in the above -referenced 
applications, U.S. Serial Nos . 08/871,784 and 08/788,471 are preferably 
employed in the present invention. 

5 

In another embodiment of the present invention, a biometric sensor 
40 of any known type may be used in lieu of, or in conjunction with the 
microphone, to collect biometric data to be processed by the biometric 
processor module 22 using known techniques, e*g., finger, thumb or palm 
10 print data, handwriting data, a retinal vascular pattern data or a 

combination thereof. Again, in a further embodiment of the present 
invention, PIN or password verification may be utilized in lieu of, or in 
addition to such biometric verification techniques. 

15 After the biometric data is processed by the acoustic processing 

module 16 (when voice verification is utilized) or the biometric processor 
module 22 (when other biometric verification methods are used) , or both, a 
determination is made as to whether the user is an authorized user (step 
208) • If the user is not verified, the selected card information will not 

20 be written to the Universal Card 26 (step 210) . If the user is verified, 
the digital certificate (previously obtained in the client/server mode) is 
retrieved from memory 14 emd loaded into the digital certificate processor 
module 20. The digital certificate processor module 20 processes the 
digital certificate to determine whether the digital certificate is still 

25 valid (i.e., xinexpired) and whether the use of the selected card has been 

prohibited or limited by the user requested limitations of such card 
during the client/server mode (step 212) . If the digital certificate is 
not valid (i.e., expired), the selected card information will not be 
written to the Universal Card 26 (step 210) . 

30 

If the digital certificate is valid (i.e., unexpired) the requested 
card information is then retrieved from memory 14 and stored in the 
encrypter/decrypter module 24. The selected card information is then 
decirypted by the encryption/decryption module 24 using an encryption key 

35 unique to the PDA device 10 (step 214) . The decrypted card information is 

then sent to the smartcard reader/writer 30 where it is then written to 
the Universal Card 26 (step 216) . The Universal Card 26 is then removed 
from the smartcard reader /writer 30 euid swept through the magnetic reading 
device of the transaction terminal 80 (Fig. 3) (step 218) . The consumer 

40 transaction information is then sent to the proper financial institution 

70 via communication link L4 (step 220) . 



45 



In a more advanced transaction terminal 80, the Universal Card 26 
may be overwritten with a receipt of the transaction by the POS or ATM 
trcinsaction terminal 80 (step 222) . With this feature, the user can keep 
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an accounting of his or her transactions by inserting the Universal Card 
26 into the smartcard reader /writer 3 0 and then loading the receipt 
information into the memory 14 of the PDA device 10 {step 224) . The user 
can subsequently transfer such information to a personal computer 
5 containing accounting software such as the software sold under the 

tradename QUICKEN. 

Advantageously, the present invention is immediately employable with 
the current infrastructure since the Universal Card 26 is compatible with 
10 all credit card and/or smartcard electronic fund transfer systems (e,g./ 

systems that process ATM cards, debit cards, credit cards, access control 
cards, calling cards and/or service cards). 

It is to be appreciated that the present invention may be used to 
15 store and access personal information such as medical, financial 

information and other confidential information which may be accessed and 
written to the Universal Card 26 or displayed on the user 

interface/display 34 (assuming a valid digital certificate and local user 
verification) . For example, medical doctors with special smartcards can 
20 access certain medical information from the PDA device of a patient (upon 

patient verification) by writing such information to the smartcard via the 
smartcard reader/writer of the PDA device 10. Alternatively, such 
information may be transferred by wireless communication between the PDA 
device of the patient and the PDA device of the doctor. 

25 

It is to be further appreciated that the invention may interact with 
electronic fund transfer systems or transaction terminals having wireless 
or direct communication capabilities without even having to use the 
Universal Card 26, Specifically, as demonstrated by the dotted lines in 

30 Fig. 5, the consumer transaction may be performed by transmitting the 

selected card information directly from the PDA device to the ATM or PCS 
transaction terminal through an established communication link L2 (step 
228, Fig. 3) (i.e., via the serial port 42, the parallel port 44 modem 42, 
the IR port 54 or the RF port 50) , rather than retrieving and writing card 

35 information to the Universal Card 26. Further, a receipt of the 

transaction can be directly transmitted to the PDA device 10 through the 
commiinication link L2 (step 230) . It is to be understood that in this 
embodiment, the CPU 12 of the PDA device 10 will prohibit the selected 
card information from being retrieved and transmitted to the transaction 

40 terminal 80 if the user is not biometrically verified and/or if the 

digital certificate is not valid (step 226) . in this particular 
embodiment of the present invention, the PDA device 10 itself actually 
takes the place of the Universal Card 26 and, consequently, eliminates the 
need of having to first write the selected card information to the 
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Universal Card 26 and then sweep the Universal Card 26 through the 
magnetic reader of the POS or ATM transaction terminal. 

Advantageously, the present invention provides biometric security 
5 for transactions that do not involve electronic data transfer such as 

transactions that are processed with traditional mechanical credit card 
sweepers or transactions that are performed remotely over the telephone. 
In such situations r a merchant can confirm that the user passed local 
verification by using the unique Universal Card number 27 (Fig. 2) 
10 together with an authorization nxamber which is based on the current valid 

digital certificate and generated upon user verification. 

By way of example, referring to Fig. 6, a flow diagram illustrating 
the local mode of the PDA device 10 during a remote (or mechanical 

15 sweeper) consumer transaction is shown. when operating the PDA device 10 

in the local mode, if the user is biometrically verified (step 308) and 
the PDA device 10 contains an unexpired digital certificate (step 310) , 
the selected card information is retrieved from memory 14 and decrypted 
(step 314) . The desired credit card information, as well as an 

20 authorization number, is then displayed on the user interface/display 34 

(step 316) . This information can then be verbally communicated to the 
merchant in order to process the transaction* If the user is not 
biometrically verified, or if the PDA device 10 contains an expired 
digital certificate, the selected card information and authorization 

25 number will not be displayed, (step 312) . 

The merchant can verify that local verification of the user has been 
properly obtained by establishing a communication link L3 (Fig. 3) with 
the central server 60, If the selected card information corresponds to a 

30 credit card that was previously enrolled (i.e., registered) with the 

service provider of the PDA device 10 and Universal Card 26, upon 
transmitting the selected card information to the financial institution 
(or calling such institution to confirm the validity of the credit card) , 
the merchant will be requested to provide the authorization number (which 

35 is generated upon user verification) , in addition to the expiration date 

of the credit card. The merchant will then transmit the Universal Card 
number 27 and the displayed authorization number to the central server 60. 
Since the authorization number is a function of the unexpired digital 
certificate that was obtained from the central server 60 in the 

40 client/server mode, the central server 60 inform the merchant that the 

user was properly verified (step 318) . 

It is to be appreciated that local verification may also be 
performed by signature verification, whereby a digitized image of the 
45 user's valid signature is displayed on the user interface/display 34 using 



wo 99/08238 



PCT/GB98/02283 



17 

Joiovrn. techniques so that a merchant can compare the digitized signature on 
the screen to the user's written signature to provide further 
authentication* Further, the present invention may utilize any 
conventional pressure sensitive display wherein the user of the PDA device 
5 10 may sign his or her signature on the display, which is then processed 

and compared with an authentic digitized signature stored in the memory 14 
of the PDA device 10. An example of such technique is disclosed, for 
example, in "Automatic On-Line Signature Verification," by Vic Nalwa, 
Proc. IEEE, pp, 215-239, February, 1997. 

10 

It is to be further appreciated that the PDA device 10 and system of 
the present invention can be configured to afford an additional level of 
security for user verification, whereby the financial institution (e.g., 
credit card company) can verify the identity of the consumer during a 

15 purchase transaction. Specifically, during a consumer transaction, upon 

local verification (biometric, PIN and/or password) and assuming, of 
course, that a valid digital certificate was previously downloaded from 
the central server 60, the PDA device 10 can be programmed to download the 
selected card information in encrypted form to the Universal Card 26, as 

20 well as an encrypted file containing unique identifying information 

pertaining to the consumer including, but not limited to, such as the 
consumer ' s name cind account number (issued by the service provider of the 
PDA device 10 and Universal Card 26) . The selected card information, as 
well as the encrypted information file, would be transmitted to the POS 

25 terminal (via the Universal Card, RF or IR) and then transmitted in 

encrypted form directly to the processing financial institution together 
with the purchase details. 

Similarly, for purchase transactions with remote services (e.g. via 
30 the internet with a merchant's Web site), the selected card information in 

encrypted form, as well as the encrypted user information, would be 
transmitted via modem (TCP/IP) to the remote service (i.e., web site) and 
then transmitted in encrypted form to the financial institution. it as to 
be appreciated that the encrypted information may be transmitted to the 
35 merchsint's Web site either directly from the modem 58 of the PDA device 

10, or by downloading such information to the Universal Card 26, which is 
then read and transmitted by a PC equipped with a smartcard reader and a 
modem . 

40 Next, assuming the credit card was previously enrolled with the 

service provider, the processing financial institution would posses the 
requisite key (provided by the service provider upon enrolment) to decode 
(i.e., decrypt) the transmitted information to verify the identity of the 
user. Consequently, the processing financial institution would provide an 

45 authorization number for the transaction to the merchant if the consiimer 
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was verified or, on the other hand/ deny the transaction and inform the 
merchant if the consumer is not authorized to use the selected card. 
Alternatively, the PDA device 10 can be programmed to download a copy of 
the valid temporary digital certificate in encrypted form (as well as the 
5 selected card information in encrypted form) to the Universal Card 26, 

whereby the digital certificate containing the requisite information to 
identify the user would be transmitted (with the selected card 
information) to the corresponding financial institution, 

10 The present invention has heretofore been illustrated as a separate 

portable device. It is to be understood by one of ordinary skill in the 
art that the configuration of the present invention may be embedded in 
other CPU based systems such as a cellular phone, a portable laptop, a 
network computer (NC) , or a PC having built in the components of the above 

15 described PDA device 10. For example, a portable laptop having the 

smartcard reader /writer 3 0 of the PDA device 10 may be directly connected 
to the central server 6 0 through a modem or through an internet server by 
protocols such as TCP/IP to download a valid digital certificate. 

20 Moreover, the functions and components of the PDA device 10 may be 

built into a cellular phone, whereby communication with the central server 
€0 may be achieved through a cellular communication channel, which may be 
analog or digital (e.g., CDMA, GSM, etc.), 

25 It is to be appreciated by one of ordinary skill in the art that a 

special ATM, kiosk or POS terminal can be employed to perform the methods 
and functions of the present invention in lieu of the actual PDA device, 
thereby eliminating the need to physically posses the PDA device 10, For 
instance, a smartcard having a valid digital certificate and the user's 

30 verification data (e.g, biometric data (voice print) , PIN and/or password) 

and card information stored thereon may be inserted into the ATM, kiosk or 
POS terminal, which are be equipped with biometric sensors such as a 
microphone. The ATM can then verify the user b iomet rical ly or via PIN or 
password. Assuming the digital certificate is valid, the ATM can then 

35 initialize the smartcard which may then be used to perform, for example, a 

purchase transaction. The smartcard may then be used for the duration of 
the validity of the digital certificate (i.e., until the digital 
certificate expires) or until another card is loaded. In this embodiment, 
the smartcard can be used for only a limited eimount of transactions. 

40 

The digital certificate may be downloaded to the smartcard by any 
method analogous to the PIN maintenance techniques disclosed in the above 
U.S. Serial No. 08/873,079, "Portable Acoustic Interface For Remote Access 
to Automatic Speech/Speaker Recognition Server." For example, the user 
45 may establish a communication link with the central server 60 service 
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provider through a personal computer having a smartcard reader, whereby a 
valid digital certificate may be download onto the smartcard after the 
user provides verification information such as user ID, PIN, smartcard 
serial number, and/or biometric data. 

5 

It is to be further appreciated that the PDA device 10 of the 
present invention may be used as a personal credit card center whereby 
fiands may be directly transferred between individuals having such PDA 
devices via credit cards or debit cards. For example, assume that User A 

10 owes User B a certain cimount of money. User A will perform local 

verification {assiaming that user A has a valid digital certificate) to 
download selected credit card or debit card information to User A's 
Universal Card. User A will then provide User B with the Universal Card 
which is then inserted into the smartcard reader /writer 3 0 of the PDA 

15 device 10 of User B. User B then selects the amount of money to be 

transferred (i.e., debited) from the Universal Card (i.e., selected credit 
card) to any one of User B's enrolled financial accounts (e.g., credit 
card accounts) . User B then obtains the authorization number produced by 
the PDA device of User A upon local verification, and enters such number 

20 into the PDA device of User B, Of course, the above procedure may be 

performed directly (e.g., via IR communication) instead of physically 
exchanging the Universal Card. 

To prevent fraudulent transactions, the authori2ation number 
25 produced by the PDA device of User A must be inputted into the PDA device 

of User B after the amount of the transaction is entered into the PDA 
device of User B and verified by User A. In other words, the PDA device 
of User B must be configured such that the authorization number from User 
A will not be accepted by the PDA device of User B unless the amount of 

3 0 the transaction is first entered into the PDA device of User B. Moreover, 

the PDA device of User B must be configured such that the authorization 
nximber of User A entered into the PDA device of User B is valid for only 
one transaction (i.e., one amount of money entered into the PDA device of 
User B) , whereby the entire process must be subsequently repeated for each 
35 additional transaction between user A and User B. Alternatively, to 

prevent fraud, the PDA device of User A may be configured such that the 
authorization number produced by the PDA device of User A contains the 
amount of money to be transferred to the account of User B in an encrypted 
or, otherwise, hidden form so that User B cannot access and manipulate 

4 0 such amount. 

After entering User A's authorization nxamber. User B will establish 
a communication link with the service provider to verify that the 
authorization number corresponds to User A's unique Universal Card number 
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and then have the funds transferred to User B's selected account (assuming 
the account is registered with the service provider) . 

One of ordinary skill in the art can envision various methods for 
implementing the present invention for communicating the selected card 
information. For instcince, in the near future, information may be 
communicated between individuals and systems via personal area network 
(PAN) which links special electronic devices having a transceiver and CPU 
carried on the individuals using human conductivity. Such concept may be 
employed in the present invention whereby the selected card information is 
transferred upon human contact (e.g., shaking hands) rather than being 
transferred through a magnetic or smartcard or wireless communication. 
Specifically, the present invention may be embedded into the CPU of a PAN 
device whereby selected card information may be transmitted to receiving 
devices such as ATM' s and POS terminals which are equipped with the 
requisite software and hardware to support PAN data exchange. 
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CLAIMS 

1. A portable information and transaction processing device, 
comprising : 

central processing unit for controlling the functioning and for 
processing a plurality of operations of said device; 

memory meeuis, operatively coupled to said central processing unit, 
for storing financial and personal information and for storing a temporary 
digital certificated- 
communication means, operatively coupled to said central processing 
unit, for establishing a communication link with a central server, 
disposed at a remote location, to obtain said temporary digital 
certificate; 

user interface means, operatively coupled to said central processing 
unit, for initiating at least one of said plurality of operations of said 
device emd selecting a portion of one of said financial and personal 
information from said memory means; 

a universal card, detachably coupled to said central processing 
unit, for receiving said selected portion of one of said financial and 
personal information; and 

programming means, operatively coupled to said central processing 
unit and responsive to said temporary digital certificate, for writing 
said selected portion of one of said stored financial and personal 
information to said universal card, whereby said programming means is 
prevented from writing said selected portion of one of said financial and 
personal information to said universal card when said temporary digital 
certificate is invalid. 

2. The device according to claim 1, further comprising verification 
means, operatively coupled to said central processing unit, for verifying 
an authorized user and for preventing said programming means from writing 
said selected portion of one of said financial and personal information to 
said universal card unless verification data is provided by said 
authorized user of said device. 

3. The device according to claim 2, wherein said verification means 
includes biometric verification means and said verification data is 
biometric data. 
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4. The device according to claim 3, wherein said biometric verification 
mecins includes: biometric sensor means for gathering said biometric data; 
and biometric processing means for processing said biometric data to 
determine if said biometric data is provided by said authorized user, 

5. The device according to claim 3, wherein said biometric data is 
derived from one of a finger, thumb or palm print, a voice print, a 
handwriting sample and a retinal vascular patter and a combination 
thereof . 

6. The device according to claim 4, wherein said biometric verification 
means performs speaker verification and said biometric data is voice data, 

7. The device according to claim 6, wherein said speaker verification 
is text- independent speaker verification. 

8. The device according to claim 1, further comprising 
encrypting/decrypting means, operatively coupled to said central 
processing unit, for encrypting said personal ajid fineuicial information 
prior to said information being stored in said memory means cOid for 
decrypting said selected portion of one of said stored financial and 
personal information. 

9. The device according to claim 1, further comprising speech 
recognition means, operatively coupled to said central processing unit, 
for processing voice commands from an authorized user of said device. 

10. The device according to claim 9, wherein said speech recognition 
means includes a microphone for receiving audio voice signals and 
converting said audio voice signals to electrical signals, and acoustic 
processing means, operatively coupled to said microphone, for processing 
said voice commands. 

11. An information and transaction processing system, comprising; 

a portable information and transaction processing device having: 

a central processing unit for controlling the functioning ajid for 
processing a plurality of operations of said device; 

memory means, operatively coupled to said central processing unit, 
for storing financial and personal information and for storing a temporary 
digital certificate; 
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verification means, operatively coupled to said central processing 
unit, for receiving and processing verification data from an authorized 
user to verify said authorized user; 

5 communication meeins, operatively coupled to said central processing 

unit, for transmitting and receiving data over a communication channel; 

user interface means, operatively coupled to said central processing 
means, for initiating at least one of said plurality of operations of said 
10 device and selecting a portion of one of said financial and personal 

information from said memory means; 

means, responsive to said temporary digital certificate, for 
transferring said selected portion of one of said financial and personal 
15 information to a peripheral system for commencing a transaction; and 

a central server, remotely connected to said communication channel, 
for generating said digital certificate, said digital certificate being 
transmitted to said portable information and transaction processing device 
20 over said communication channel emd stored in memory means of said device. 

12. The system of claim 11, wherein said central server includes means 
for processing said verification data transmitted from said portable 
device to verify said authorized user, whereby said digital certificate is 

25 transmitted to said portable device if said authorized user is verified. 

13. A method for performing an electronic data transfer transaction in a 
portable information ajad transaction processing system having a 
client/server mode of operation and a local mode of operation, the method 

30 comprising the steps of: 

performing said client/server mode of operation to obtain a 
temporary digital certificate, said client/server mode comprising the 
steps : 



35 



40 



connecting to a central server over a communication channel from a 
portable information and transaction processing device disposed remotely 
from said central server, said central server having verification data of 
an authorized user stored in a memory; 

inputting verification data into said portable device; 



45 



transmitting said inputted verification data over said communication 
channel to said central server; 
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processing said verification data provided to said central server by 
using said stored verification data of said authorized user to verify 
user; and 

transmitting said temporary digital certificate over said 
communication link if said authorized user if verified after said 
processing of said transmitted verification data; and 

performing said local mode of operation, wherein said local mode of 
operation comprises the steps: 

providing verification data of an authorized user of said system; 

processing said verification data to verify said authorized user; 

determining if said temporary digital certificate is valid; 

selecting at least a portion of one of personal and financial 
information; and 

transferring said selected portion of one of said personal and 
financial information to an external system if said authorized user is 
verified and it is determined that said temporary digital certificate is 
valid. 
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